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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1 308. 

1 . ^ This communication is responsive to the after final amendment filed 3/4/2010 . 

2. lEI The allowed claim(s) is/are 1.4.9-11.14-16 and 20-22 . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) Dan b)nSome* c) □ None of the: 

1. n Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. O Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 
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9. □ Other . 
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NOTICE OF ALLOWABILITY 
This Office Action is in response to the after final amendment filed March 4, 2010, 
in which Applicant has amended claim 1. Currently, claims 1, 4, 9-11, 14-16, and 20-22 
are pending. 

Allowable Subject Matter 

1. Claims 1, 4, 9-1 1, 14-16, and 20-22 are allowed. 

2. The following is a statement of reasons for the indication of allowable subject matter: 

3. Regarding claim 1, the prior art of record fails to specifically teach or disclose a method 
in a speech recognition system, comprising generating a synthetic waveform for each of N 
textual transcriptions of an original waveform, wherein N is greater than 1 and the N textual 
transcriptions are generated by a speech recognition system and represent N-best textual 
transcription hypotheses of the original waveform; for each synthetic waveform, time-aligning 
feature vectors of the synthetic waveform with feature vectors of the original waveform at a 
phoneme level; computing a mean of the feature vectors which align to each phoneme for the 
original waveform and the synthetic waveform; computing a distance measure between each 
phoneme mean of the original waveform and the synthetic waveform; summing the distance 
measures to generate an overall distance measure representing a distance between the original 
waveform and the synthetic waveform; comparing scores based on the overall distance measure 
between the synthetic waveform and the original waveform, an acoustic model score of a 
corresponding textual transcription of the synthetic waveform, and a language model score of the 
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corresponding textual transcription to determine a corresponding one of the N-best textual 
transcriptions; and selecting for output the determined N-best textual transcription. 

4. Regarding claim 9, the prior art of record fails to specifically teach or disclose a method 
for recognizing speech, the method comprising the steps of: generating a synthetic waveform for 
each of N textual transcriptions of an original waveform, wherein N is greater than 1 and the N 
textual transcriptions are generated by a speech recognition system and represent N-best textual 
transcription hypotheses of the original waveform; for each synthetic waveform, computing a 
distance measure between the synthetic waveform and the original waveform; summing the 
distance measures to generate an overall distance measure representing a distance between the 
original waveform and the synthetic waveform; generating a score S from the overall distance 
measure D, an acoustic model score A of the corresponding textual transcription for the synthetic 
wave, and a language model score L of the corresponding textual transcription, wherein the score 
S = -D + (a * A) + (b * L), and 'a' and 'b' are constants; and selecting for output one of the 
textual transcriptions corresponding to the synthetic waveform having the score that indicates the 
synthetic wave is closest to the original waveform. 

5. Regarding claim 15, the prior art of record fails to specifically teach or disclose an 
automatic speech recognition system, comprising: a decoder for decoding an original waveform 
of acoustic utterances to produce N textual transcriptions, the N textual transcriptions 
representing N-best textual transcription hypotheses of the decoded original waveform; a text to 
speech system generating a synthetic waveform for each of the N textual transcriptions; a means 
to perform a speaker normalization on the original waveform to match vocal-tract characteristics 
of a speaker from whose data the TTS is derived; and a comparator for comparing scores based 



Application/Control Number: 09/286,099 Page 4 

Art Unit: 2626 

on an overall distance measure between each synthetic waveform and the normalized original 
waveform, an acoustic model score of a corresponding textual transcription of the synthetic 
waveform, and a language model score of the corresponding textual transcription to determine a 
corresponding one of the N-best textual transcriptions to output, wherein the overall distance 
measures are computed by a processor: computing a distance measure between the synthetic 
waveform and the normalized original waveform; and summing the distance measures to 
generate an overall distance measure representing a distance between the normalized original 
waveform and the synthetic waveform, and wherein N is greater than 1 . 



6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ANGELA A. ARMSTRONG whose telephone number is 
(571)272-7598. The examiner can normally be reached on Monday-Thursday 1 1 :30-8:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on 571-272-7602. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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